(19) 



J 



(12) 



(43) Date of publication: 

20.03.1996 Bulletin 1996/12 

(21) Application number: 95306046.4 

(22) Date of filing: 30.08.1995 



Europdisches Patentamt 
European Patent Office 

Office europ6en des brevets (1 1 ) EP 0 702 492 A1 

EUROPEAN PATENT APPLICATION 

(51) IntCI^: H04N7/173 



(84) 


Designated Contracting States: 


(72) 


Inventor: Butcher, John Anthony Weeks 




DE FR NL SE 




Stansted, Essex CiVI24 8JA (GB) 


(30) 


Priority: 15.09.1994 GB 9418584 


(74) 


Representative: Ryan, John Peter William et al 








Nortel Limited 


(71) 


Applicant: NORTHERN TELECOiVI LIIVIiTED 




Patents and Licensing 




IWontreal, Quebec H2Y 3Y4 (CA) 




West Road 








Harlow Essex CM20 2SH (GB) 



(54) Interactive video system 

(57) In video on demand (VOD) problems may be 
caused by potential transmission, queuing and process- 
ing delays in the network which can lead to erratic and 
erroneous operation of VOD systems when responding 
to viewer commands. This problem is overcome by 
employing a video frame reference number in the return 
signalling channel to the video server so that the com- 
mand is related to the correct frame. At the same time 
the viewers display is halted until the revised frame is re- 
received so that the display is re-enabled at the correct 
point in the program. 
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Description 

This invention relates an interactive video system 
wherein subscribers to the system can affect the opera- 
tion of so-called Video-on-demand' services. 

BACKGROUND OF THE INVENTION 

Interactive video systems are being developed in 
which a master station can be accessed by a subscriber, 
using either a telephone line or a return channel in a 
duplex fibre optic video transmission link, whereby the 
subscriber can in the course of transmission of video 
material from the master station transmit back to the 
master station signals which will modify subsequently 
transmitted video material. British patent application GB 
21 2050 7A describes a video game system in which the 
head end of a cable TV system transmits on request an 
interactive video game programme. At various times dur- 
ing the course of the programme the subscriber may 
transmit instructions back to the head end to alter the 
subsequent playing of the game. Further descriptions of 
interactive video systems are given by Deloddere et al. 
in IEEE Communications Magazine vol. 32 No. 5 pp 82 
to 88, and by Calvert et al. in Electrical Communication 
No. 3 September 94 pp 281 to 289. 

With the development of ever more sophisticated 
video games requiring greater skill and speedier reflexes 
on the part of the subscriber a problem can arise 
whereby the propagation delays in both the transmission 
from the head end of the video game material and the 
transmission back to the head end of the subscriber's 
instructions can lead to incorrect modification of the sub- 
sequently transmitted video game material. Take for 
example a game in which the subscriber 'player' is 
required to 'shoot' a gun at a swiftly moving target. Such 
an action can require split-second timing. If the transmis- 
sion propagation times are comparatively long the 
player's 'shoot* instruction will be received at the head 
end some time after the target has effectively moved out 
of the 'line-of-f ire*. Of course, if for a particular subscriber 
the round trip propagation time is known then a pre-cal- 
culated adjustment factor can be built into the system. 
However, with modern cable TV systems a single head 
end can serve a large subscriber area with differing prop- 
agation times for all the subscribers. 

SUMMARY OF THE INVENTION 

According to the present invention there is provided 
an interactive video system wherein a master station 
(head end) transmits over a network video material to a 
subscriber equipments, the system having means 
whereby individual subscriber equipments can transmit 
back to the master station command signals to control 
and modify subsequent real time transmission of the 
video material, in which the transmitted video material 
incorporates video frame reference data, characterised 
in that the subscriber equipments include command 



transmission means for transmitting with a command sig- 
nals frame reference data identifying the video frame to 
be associated with the command signals, the master sta- 
tion having means responsive to the receipt of the com- 

5 mand signal to revert to the referenced frame and 
recommence transmission of the video material from that 
frame, said retransmission being modified as required by 
the command signal. 

In a preferred embodiment of the invention the sub- 

10 scriber equipments include means for pausing the dis- 
play of received video material at the referenced frame 
associated with the command signal and recommencing 
display of the video material on reception of the retrans- 
mitted material. 

15 

SUMMARY OF THE INVENTION 

An embodiment of the invention will now be 
described with reference to the accompanying drawing 
20 which is a block diagram showing the principal elements 
of typical video-on-demand (VOD) network configura- 
tions. 

DESCRIPTION OF PREFERRED EMBODIMENT 

25 

Referring to the drawing, the diagram shows a head 
end video server 10 serving both asymmetrical digital 
subscriber line (ADSL) 12 and quadrature amplitude 
modulation (QAM) 14 broadband access module (BAM) 
30 arrangements via an asynchronous transfer mode (ATM) 
cell 16. 

In the case of the ADSL BAM, distribution to individ- 
ual viewer's (customer) premises is via individual con- 
ventional telephone pairs 18 which may have POTS 

35 (Plain Ordinary Telephone Service) telephony imposed 
on it. Upstream control signaling from the viewer's 
remote control unit 20 via the TV set 22, set top box 24 
and line interface 26 is a discrete low speed (possibly 
ATM based) signalling channel which, via processing in 

40 the BAM is used for VOD channel selection and VOD 
channel control. 

The main problem to be solved with respect to con- 
trol signalling is the provision of an arrangement whereby 
from the remote control unit adjacent to viewer's terminal 

45 equipment it is possible to satisfactorily control the video 
server in much the same way as one would control a 
locally sited VCR. i.e. pause, search forward and back, 
high speed fonward and back. etc. during the playback 
of a video. Where the video server also provides a dis- 

50 tance learning capability, the remote control must be able 
to control and direct the course of study down selectable 
optional routes so that various topics may be explored in 
greater (or less) depth or repeated as may be desired by 
the viewer. Similarly, where the video server provides a 

55 distance game playing capability, the remote control 
must be able to control and direct the course and hence 
the outcome of the game with the maximum of smooth 
action. 
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The point of the problem on the control signaling 
requirement is that there is a finite transmission delay 
time for video signals from the server to the viewer and, 
in the reverse direction, for control signaling to the server 
from the viewer. These transmission delays arise (not so 
much) from the physical distances over which video and 
control signals have to flow {but due to ATM) and , pos- 
sibly principally, from processing, e.g. ATM. and possibly 
queuing if the network becomes congested or there is 
signalling congestion/contention at a subscriber 
premises because more than a single video terminal set 
is being serviced. In the case of the QAM BAM approach, 
further delay is introduced by any multiplexing operations 
in the hybrid fibre/coax distribution chain and the require- 
ment for a TDMA non-collision protocol to handle the 
upstream signaling. 

The effect of this delay is that by the time the vi ewer's 
control (switch) signal reaches the video server, the 
server will be transmitting later (in time) video frames to 
the viewer, some of which may well still be in transit to 
the viewer while others, those transmitted immediately 
after the viewer entered his command will probably have 
arrived and have been displayed. 

The viewer's command refers to the video frames he 
was viewing at the time of his command initiation. How- 
ever, the viewer's command signal will have arrived 
somewhat later at the server where, unless precautions 
are taken, the command will control the server operation 
with respect to the current (i.e. later) video frames being 
transmitted. This, of course, can have disturbing and 
even disastrous effects as far as the viewer is concerned. 
At the very least the viewer is likely to sense "inertia" or 
non-responsiveness in the system whereby a sequence 
of video frames does not immediately pause, rewind, etc. 
This is referred to as latency'. At worst, in a distance 
learning environment, an available optional route choice 
may be lost because the currently transmitted video 
frames from the server may have passed on past the 
option presentation point because a time-out has 
expired. 

If, however, the interactive distance learning scheme 
is based solely upon the elementary concepts of Com- 
pact Disc Interactive (CD-I) operation as currently avail- 
able, then the interactive distance learning scheme may 
not suffer from the problem indicated above since dis- 
plays are staticised when options are presented to the 
viewer. Nevertheless to limit interactive distance learning 
schemes in this manner is inhibiting to the development 
of their full potential and therefore such an approach is 
not to be recommended. Further, an interactive distance 
learning scheme based upon the current CD-I approach 
to cursor control, etc. would possibly add further terminal 
electronics into the viewer's terminal equipment since it 
could prove impractical due to signalling loading to con- 
trol the cursor movement via the upstream signaling 
channel and thereby right back at the distance learning 
source associated with the server. This whole area of 
interactive distance learning requires further investiga- 
tion; it is a topic that is still in the gestation stage and 



should be allowed to develop to some degree of maturity 
rather than being constrained unduly by pre-conceived 
overall VOD systems aspects. 

The invention provides a twofold solution to the 

5 above problems. 

First, the viewer's upstream command signaling is 
to contain the video frame reference number relevant to 
the instant the command signal was initiated. It is a sim- 
ple matter to insert this information into a signalling mes- 

10 sage. 

Second, where the viewer's upstream command sig- 
nal requires the video sequence being displayed to 
change in relative time, e.g. pause, forward, reverse, etc. 
or change topic, the frame being displayed on the 

75 viewer's TV set is staticised until, as a result of the com- 
mand being exercised by the by the video server, a new 
sequence of video frames begins to be received at the 
viewer's terminal. 

By using a video frame reference number, the head 

20 end server is able to backtrack to the video frame at 
which the viewer initiated his command and then act on 
the command from that point. Thus precision is given to 
the point in the video sequence to which the command 
refers. 

25 Staticising the viewer's video display by local action 
at the viewer's terminal prevents the video sequence pro- 
ceeding forwards then suddenly reverting to the frame at 
which the command was initiated and from which the 
command will be seen to be exercised. Staticising is 

30 seen as being preferred to banking; it suggests some- 
thing is about to happen - banking suggests to the user 
that the whole system may have failed! 

To provide video frame reference numbers, it is nec- 
essary that the individual video frames being delivered 

35 to viewer's terminals contain sequentially numbered 
frames. Employing sequentially numbered video frames 
in the analogue environment for video editing purposes 
is commonplace today. 

The Motion Picture Experts Group (MPEG) encoded 

40 video frames are also sequentially numbered as a check 
on the coding, transmission and decoding processes. 
Further, these frame sequence numbers are available for 
use external to the MPEG Chipset (and have to remain 
so in the future for this solution to work); the sequence 

45 numbers are provided by combination of the SRC (Sys- 
tem Reference Clock) and PTS (Presentation Time 
Stamps) within the MPEG bit stream. Thus, the video 
frame reference numbering described herein applies to 
MPEG 1. MPEG 11 and MHEG video enconding sys- 

50 tems. 

Further, the video frame reference numbering 
described herein also applies to any video encoding or 
transmission system where the individual video frames 
contain sequence numbering or timing references that 
55 can be accessed both at the video storage source, for 
example, a video server and at the subscriber's or 
viewer's terminal equipment. 

The other requirement is the ability to staticise the 
video frame on the viewer's terminal. This implies the 
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provision of a frame store within the set top box. This is 
already provided since the MPEG video signals have to 
be decoded and presented to a conventional TV set. 

While this invention has been described on the 
assumption that digital video encoding will be used, this 5 
is not mandatory for the system to work. Reference has 
already been made to the provision of frame numbering 
for editing analogue video pictures. In principle, this 
video frame numbering of analogue video frames allows 
the system described herein to be used in conjunction io 
with analogue video transmission systems. 

Claims 

1. An interactive video system wherein a master sta- is 
tion (head end) transmits over a network video mate- 
rial to a subscriber equipments, the system having 
means whereby individual subscriber equipments 
can transmit back to the master station command 
signals to control and modify subsequent real time 20 
transmission of the video material, in which the 
transmitted video material incorporates video frame 
reference data, and wherein the subscriber equip- 
ments include command transmission means for 
transmitting with command signals frame reference 25 
data identifying the video frame to be associated 
with each command signal, the master station hav- 
ing means responsive to the receipt of each com- 
mand signal to revert to the respective referenced 
frame and recommence transmission of the video so 
material from that frame, said retransmission being 
modified as required by the command signal. 

2. A system as claimed in claim 1, wherein the sub- 
scriber equipment includes means for staticising a 35 
video display during the period between transmis- 
sion of the frame reference data and reception of the 
recommenced transmission. 

3. A method of operating an interactive video system 40 
wherein a master station (head end) transmits over 

a network video material to a subscriber equip- 
ments, the system having means whereby individual 
subscriber equipments can transmit back to the 
master station command signals to control and mod- 45 
ify subsequent real time transmission of the video 
material, the method including incorporating video 
frame reference data in the transmitted video mate- 
rial, transmitting from the the subscriber equipment 
command signals incorporatingframe reference so 
data identifying the video frame to be associated 
with each command signal, and, responsive to 
receipt of each command signal, reverting to the 
respective referenced frame and recommencing 
transmission of the video material from that frame, 55 
said retransmission being modified as required by 
the command signal. 
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